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DETAILED ACTION 

Continued Examination Under 37 CFR 1. 1 14 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since 
this application is eligible for continued examination under 37 CFR 1.114, and the 
fee set forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous 
Office action has been withdrawn pursuant to 37 CFR 1.114. Applicant's 
submission filed on 05/14/2010 has been entered. 

Claim Objections 

2. Claims 1 2 and 1 3 are objected to because of the following informalities: The 
preamble of claims 12 and 13 should be amended to properly set forth the 
dependency from the non-transitory computer readable medium set forth in claim 
1 1 . Appropriate correction is required. 

Claim Rejections - 35 USC § 1 12 

3. The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

Claims 1-6, 8-9, 11-13 are rejected under 35 U.S.C. 112, second paragraph, as 
being indefinite for failing to particularly point out and distinctly claim the subject 
matter which applicant regards as the invention. In claim 1 , line 1 7 and in claim 
1 1 , line 14, "the three dimensional model" lacks antecedent basis. In claim 1 it is 
unclear as to how one would "estimate displacement and distortion at a portion 
whose three-dimensional position is not known". 

Claim Rejections - 35 USC §103 
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4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as 
set forth in section 1 02 of this title, if the differences between the subject matter sought to be 
patented and the prior art are such that the subject matter as a whole would have been obvious 
at the time the invention was made to a person having ordinary skill in the art to which said 
subject matter pertains. Patentability shall not be negatived by the manner in which the invention 
was made. 

This application currently names joint inventors. In considering patentability of 
the claims under 35 U.S.C. 1 03(a), the examiner presumes that the subject 
matter of the various claims was commonly owned at the time any inventions 
covered therein were made absent any evidence to the contrary. Applicant is 
advised of the obligation under 37 CFR 1 .56 to point out the inventor and 
invention dates of each claim that was not commonly owned at the time a later 
invention was made in order for the examiner to consider the applicability of 35 
U.S.C. 103(c) and potential 35 U.S.C. 102(e), (f) or (g) prior art under 35 
U.S.C. 103(a). 

5. Claims 1-6, 8-13 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Grimson (US 5,999,840), in view of Shahidi (US 2001/0016684) in view of 
Ferrant et al ("Registration of 3-D Intraoperative MR Images of the Brain Using a 
Finite-Element biomechanical Model"). 

Grimson teaches a system and method having a first acquisition means that 
optically measures a surface of an operation site during surgery and that 
acquires first position information representing a three-dimensional position of 
each of points on the surface of the operation site (Fig. 1 element 116 and 
Column 5, lines 38-42. Grimson, further teaches a second acquisition means that 
measures a portion of the operation site (Fig 1, element 106 and Column 4, lines 
52-57) with ultrasonic waves (Column 5, lines 29-37) during surgery and that 
acquires second position information representing a three-dimensional position of 
each of points in the portion of the operation site (Column 5, lines 22-24). 
Grimson et al does not teach that the second acquisition means measure an 
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unexposed portion (within the brain) of the operation site. Shahidi, in the same 
field of endeavor, teaches a surgical navigation system has a computer with a 
memory and display connected to a surgical instrument or pointer and position 
tracking system, so that the location and orientation of the pointer are tracked in 
real time and conveyed to the computer. The computer memory is loaded with 
data from an MRI, CT, or other volumetric scan of a patient, and this data is 
utilized to dynamically display 3-dimensional perspective images in real time of 
the patient's anatomy from the viewpoint of the pointer. The images are 
segmented and displayed in color to highlight selected anatomical features and 
to allow the viewer to see beyond obscuring surfaces and structures. The 
displayed image tracks the movement of the instrument during surgical 
procedures. The instrument may include an imaging device such as an 
endoscope or ultrasound transducer (See Fig. 1), and the system displays also 
the image for this device from the same viewpoint, and enables the two images 
to be fused so that a combined image is displayed. The system is adapted for 
easy and convenient operating room use during surgical procedures. Therefore, 
it would have been obvious to one of ordinary skill in the art at the time of the 
invention to expand the invention of Grimson to model and register images 
acquired within the brain with pre-acquired three dimensional tomographic 
images in order to further enhanced surgical practices inside the brain by 
providing real time updates of the brain structures. In addition, it would have 
been obvious to attach the laser unit in a mounted surgical probe to be able to 
acquired images inside the brain, as shown by Shahidi. Grimson, further 
disclose correction means that, based on the first position information acquired 
by said first acquisition means and the second position information acquired by 
said second acquisition means correcting apposition of a portion whose three 
dimensional position is known by the firs position information and the second 
position information in a three dimensional model of the operation site (see for 
example col. 6, lines 30-53). However, Grimson fail to disclose to estimating a 
displacement and distortion of a portion that is not known in the three 
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dimensional model (i.e. a portion of the brain) and re-correcting the three- 
dimensional model of the operation site by the use of a finite element method. In 
the same field of endeavor Ferrant discloses a method of registration of 3-D 
intraoperative MR Images of the Brain using a Finite-Element biomechanical 
model in which based on a three dimensional model showing brains shifts, an 
algorithm tracks key surface of objects and then, the volumetric deformations of 
the brain are adjusted (i.e. 3D model) using a biomechanical finite-element model 
(see Abstract). In addition, boundary surfaces of the model of the brain can be 
estimated and adjusted. Therefore, it would have been obvious to one skilled in 
the art to have further modified Grimson with the teachings of Ferrant to provide 
an estimation and re-correction step showing brain shift using a finite-element 
method in order to improve surgical visualization of the brain. 
As per claim 2, Grimson et al. further teach a first means for acquisition ( Fig. 1 
element 116) which could be the same mean as laser camera 110 (Column 5, 
lines 40-43). Grimson et al further teaches element 110 scan the surface of the 
operation site with laser light, and detecting means and receiving laser light 
reflected by the surface of the operation site, thereby detecting a three- 
dimensional position of a portion on which the laser light is irradiated, on the 
surface of the operation site, and an operation of detecting the three- 
dimensional position by said detecting means is carried out repeatedly while 
scanning each of the points on the surface of the operation site with laser light, 
thereby acquiring the first position information. 

As per claim 3, Grimson et al. further teach said first acquisition means (Fig 1. 
element 116) further comprises image pickup means producing images of the 
surface of the operation site (Column 5, lines 16-24), and said correction means 
is provided so as to estimate displacement and distortion at each of the points in 
the operation site also using images produced by said image pickup means. 
As per claim 4, Grimson et al further teach the limitations of said second 
acquisition means (Fig 1, element 106) comprises a probe (Fig 1, element 110) 
that transmits ultrasonic waves to the operation site and receives ultrasonic 
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waves reflected by the points in the portion of the operation site, and conversion 
means that converts the ultrasonic waves received by the probe to tomographic 
images, and said second acquisition means is provided so as to acquire the 
second position information by obtaining the three-dimensional position of each 
of the points on the ultrasonic tomographic images obtained by said conversion 
means (Column 5, lines 29-36). Grimson et al. disclose the element 116 could 
be the same as laser scanning unit 110 (Column 5, lines 40-42) which the laser 
scanning unit. 

As per claim 5, Grimson et al. further teach a said first acquisition means 
comprises a scanning device (Fig 1, element 116), and scanning the surface of 
the operation site with laser light and detecting means and receiving laser light 
reflected by the surface of the operation site, thereby detecting a three- 
dimensional position of a portion on which the laser light is irradiated, on the 
surface of the operation site (Column 5, lines 40-43) and (Column 5, lines 16-24) 
Grimson et al. teaches said first acquisition means also detects the three- 
dimensional position of the probe of said second acquisition means; and said 
second acquisition means obtains, based on the three-dimensional position of 
the probe detected by said first acquisition means, the three-dimensional position 
of each of the points on the ultrasonic tomographic image (Column 4, lines 33- 
35) (Column 5, lines 40-42) and (Column 4, lines 3-6). 

As per claim 6, Grimson et al further teach the limitations of the high-definition 
tomographic image are an MRI image produced by nuclear magnetic resonance- 
computed tomography (Column 3, lines 24-27). 

As per claim 8, Grimson et al. further teach wherein when the plurality of high- 
definition tomographic images are produced before a surgical operation, at least 
three first marks are applied on the periphery of the operation site, and at the 
time of the surgical operation, at least three second marks are applied to the 
vicinities of the operation site; said first acquisition means further acquires mark 
position information that represents respective three-dimensional positions of the 
first marks and the second marks; said correction means carries out, based on 
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the mark position information acquired by said first acquisition means, and 
positions of image portions corresponding to the first marks on the high-definition 
tomographic image, alignment of the high-definition tomographic image and the 
first position information and the second position information (Column 3 line 65 to 
column 4 line 11) visualizations of the patient in the operating room (Column 1, 
lines 61 -64). 

As per claim 9, Grimson et al further teach the limitations of operation of 
acquiring the first position information by said first acquisition means, acquiring 
the second position information by said second acquisition means, correcting the 
plurality of high-definition tomographic images by said correction means, and 
displaying the high-definition tomographic images by said display means is 
carried out repeatedly during the surgical operation (Column 2, lines 42-45). 
As per claim 11, the modified Grimson further teaches an image data processor 
(Fig 1. element 118) is an IBM RS6000 or IBM PVS in conjunction with a Sun 
Sparc 10 (Column 5, lines 48-50). , Grimson et al., shows that the image 
processor unit 118 is an equivalent structure known in the art. Therefore, 
because these two elements with embedded programs were art recognized 
equivalents at the time of the invention was made; one of ordinary skill in the art 
would have found it obvious to substitute the image processor unit with an 
embedded program for a "surgical operation program that causes a computer". 
As per claim 12, Ferrant clearly discloses a registration procedure using the 
Finite-Element Model that has been adjusted and the acquired 3-D MR images. 
As per claim 13, Shahidi discloses a probe that acquires images inside of the 
brain as disclosed above. 

Response to Arguments 

6. Applicant's amendments to the claims are sufficient to overcome the objection to 
the Abstract and the 35 USC 101 rejection set forth in the previous Office Action. 

7. Applicant's arguments filed 05/14/2010 have been fully considered but they are 
moot in view of the new ground(s) of rejection. 
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Conclusion 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. Miga et al (2005/0101855) which discloses a method of 
compensation of intra-operative brain shifts of a living subject.. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JOSEPH SANTOS whose telephone number is 571 - 
270-7782. The examiner can normally be reached on Monday through Thursday 
7:30am - 5:00pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, THU NGUYEN can be reached on 571-272-6967. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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/J.S./ /BRIAN CASLER/ 

Examiner, Art Unit 41 55 Supervisory Patent Examiner, Art 

Unit 3737 



